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Computer-supported  cooperative  work  (CSCW)  holds  great  importance  and  promise 
for  modern  society.  This  paper  provides  an  overview  of  seventeen  papers 
comprising  a  symposium  on  CSCW.  The  overview  also  discusses  some  relationships 
among  the  contributions  made  by  each  paper,  and  places  those  contributions  into  a 
larger  context  by  identifying  some  of  the  key  challenges  faced  by  computer  science 
researchers  who  aim  to  help  us  work  effectively  as  teams  mediated  through 
networks  of  computers.  The  paper  also  describes  why  the  promise  of  CSCW  holds 
particular  salience  for  the  U.S.  military.  In  the  context  of  a  military  setting,  the 
paper  describes  five  particular  challenges  for  CSCW  researchers.  While  most  of 
these  challenges  might  seem  specific  to  military  environments,  many  others 
probably  already  face  similar  challenges,  or  soon  will,  when  attempting  to 
collaborate  through  networks  of  computers.  To  support  this  claim,  the  paper 
includes  a  military  scenario  that  might  hit  fairly  close  to  home  for  many,  and 
certainly  for  civilian  emergency  response  personnel.  After  discussing  the  military 
needs  for  collaboration  technology,  the  paper  briefly  outlines  the  motivation  for  a 
recent  DARPA  research  program  along  these  lines.  That  program,  called  Intelligent 
Collaboration  and  Visualization,  sponsored  the  work  reported  in  this  symposium. 
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PROMISE  OF  COMPUTER-SUPPORTED 
COOPERATIVE  WORK 

Computer  science  researchers  have  long 
envisioned  using  computers  to  support 
the  work  of  teams.  Research  investigat¬ 
ing  CSCW  first  appeared  coincident 
with  the  invention  of  time-sharing  sys¬ 
tems.  The  underlying  technology  of 
time-sharing,  which  enabled  many  us¬ 
ers  to  simultaneously  share  a  computer 
and  its  files,  provided  a  platform  on 


which  researchers  could  explore 
schemes  for  grouping  information,  shar¬ 
ing  files,  and  jointly  authoring  docu¬ 
ments.  In  the  decades  since  the  inven¬ 
tion  of  time-sharing,  information 
technology  has  advanced  in  some  sur¬ 
prising  directions.  Personal  computers 
(PCs)  have  replaced  time-sharing  sys¬ 
tems,  multimedia  data  has  enriched 
simple  text  documents,  networks  have 
brought  users  together  across  vast  dis- 
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tances,  and  a  wide  range  of  interaction 
modes  have  augmented  simple  com¬ 
mand-line  interaction.  Even  today,  we 
can  see  changes  ahead  in  the  growing 
population  of  specialized  information 
appliances  with  built-in  wireless  com¬ 
munications.  Such  appliances  will  en¬ 
able  individuals  to  improve  their  ability 
to  manage  personal  information.  Yet, 
the  main  challenge  for  CSCW  research¬ 
ers  remains  the  same  —  enabling  people 
to  work  effectively  together  in  teams 
mediated  through  computers. 

The  CSCW  challenge  has  particular 
interest  for  modern  society  because  two 
trends  continue  to  accelerate.  First, 
with  increasing  frequency,  people  work 
together  in  cross-organizational  teams 
that  form  quickly  for  particular  goals 
and  then  evolve  with  changes  in  the 
nature  of  the  tasks  needed  to  achieve 
those  goals.  Such  teams  must  quickly 
establish  a  work  plan,  divide  up  tasks, 
and  determine  means  of  coordination 
and  self-regulation.  In  a  growing  num¬ 
ber  of  cases,  team  members  work  asyn¬ 
chronously,  but  their  work  must  still  be 
coordinated  effectively.  The  second  ac¬ 
celerating  trend  places  extensive  com¬ 
puting  power  into  the  hands  of  individ¬ 
ual  office  workers.  This  means  that 
professional  work  has  become  digital. 
Since  individuals  work  through  comput¬ 
ers,  teams  will  naturally  do  so  as  well. 
This  juxtaposition  of  personal  comput¬ 
ing  power  with  the  need  to  work  digi¬ 
tally  in  teams  presents  the  CSCW  re¬ 
search  community  with  an  urgent 
challenge:  improve  the  ability  of  teams 
to  work  together  through  networks  of 
computers. 

SPECIFIC  CHALLENGES  FOR  CSCW  IN 
THE  MILITARY 

This  challenge  has  particular  import  for 
the  U.S  military  because  military  oper¬ 
ations  have  entered  a  new  era  of  uncer¬ 
tainty,  requiring  agility,  rapid  response, 
and  innovative  teamwork.  In  this  heter¬ 
ogeneous  and  fast-changing  environ¬ 
ment,  information  technology  in  support 
of  adaptive  teams  can  be  a  critical  dis¬ 


criminator  for  the  U.S.  military.  For 
this  reason,  the  Defense  Advanced  Re¬ 
search  Projects  Agency  (DARPA)  chal¬ 
lenged  the  computer  science  research 
community  to  develop  some  new  collab¬ 
orative  computing  capabilities  that  ad¬ 
dress  five  specific  needs  faced  by  mili¬ 
tary  teams. 

(1)  Collaboration  across  heterogeneous 
bandwidth  and  devices.  Military 
teams  must  collaborate  across  mul¬ 
tiple  media  even  when  some  team 
members  participate  through  hand¬ 
held  devices  at  the  end  of  low-band¬ 
width  links,  while  others  work  with 
high-speed  network  connections, 
large-screen  displays,  and  powerful 
desktop  computers. 

(2)  Collaboration  using  natural  modes 
of  interaction.  Individual  soldiers 
must  interact  in  collaborative  ses¬ 
sions  using  the  modes  most  appro¬ 
priate  for  their  situation.  Speech 
recognition,  gesture,  eye-tracking, 
and  verbal  and  tactile  feedback 
must  all  work  together  seamlessly, 
along  with  the  more  conventional 
modes  of  interaction. 

(3)  Ready  access  to  information  affect¬ 
ing  collaboration.  The  immense 
amounts  of  information  produced 
and  consumed  by  military  teams 
must  be  made  more  accessible.  Spe¬ 
cifically,  as  documents  are  gener¬ 
ated  or  discovered  they  should  be 
routed  automatically  to  team  mem¬ 
bers  whose  task  might  require 
them.  In  addition,  all  interactions 
among  team  members,  whether  au¬ 
dio,  video,  or  event  data,  should  be 
archived  and  indexed  to  support 
rapid  search.  Beyond  mechanisms  to 
manage  a  team’s  information,  auto¬ 
mated  mechanisms  are  needed  to 
help  people  discover  each  other 
when  they  could  potentially  profit 
by  collaborating. 

(4)  Collaboration  without  continuous 
connectivity.  Military  units  need  to 
collaborate  asynchronously.  Given 
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the  nature  of  the  military  situation, 
where  links  and  nodes  go  up  and 
down  and  where  collaborators  come 
and  go,  collaborative  sessions  must 
persist  beyond  the  lifetime  of  any 
current  members.  Even  when  no 
members  are  present,  the  session 
must  persist. 

(5)  Evaluation  of  effectiveness  before  de¬ 
ployment.  New  tools,  techniques, 
and  metrics  are  required  to  enable 
effective  and  efficient  evaluation  of 
collaboration  technology  prior  to  its 
deployment  for  military  operations. 

The  epitome  of  military  collaboration 
appears  during  crisis  response  planning 
and  execution.  As  a  crisis  nears,  a  crisis 
action  team  (CAT)  in  a  military  head¬ 
quarters  dusts  off  skeleton  plans  for 
similar  crises  and  for  operations  in  a 
similar  geographical  area.  It  is  likely 
the  CAT  members  did  not  develop  the 
skeleton  plans.  In  fact,  this  might  be 
the  first  time  the  CAT  members  have 
worked  together  on  an  assignment.  The 
CAT  must  formulate  a  set  of  tasks  to 
quickly  complete  a  specific  plan  for  the 
current  crisis  and  geography.  Often  this 
will  involve  establishing  contact  with 
local  operatives  at  or  near  the  crisis 
site.  Sometimes  this  contact  comes 
through  limited  bandwidth  or  through 
sporadic  connections.  As  the  crisis  un¬ 
folds,  the  nature  and  duration  of  local 
contacts  can  change.  Planning  delibera¬ 
tions  also  often  include  high-level  dis¬ 
cussions  of  political  and  military  op¬ 
tions.  The  intent  of  the  commander-in¬ 
chief  typically  shapes  the  direction  of  a 
crisis  plan.  Bridging  the  different  peo¬ 
ple,  sites,  and  equipment  involved  in 
crisis  response  presents  a  major  chal¬ 
lenge.  Over  the  course  of  a  few  hours  or 
days,  the  current  situation  must  be  de¬ 
termined  and  an  adequate  plan  devel¬ 
oped.  At  that  point,  a  crisis  response  is 
“good  to  go.” 

When  given  a  “go,”  the  crisis  response 
execution  unfolds  under  the  watchful 
eye  of  the  CAT.  As  the  situation 
changes,  the  plan  must  be  adapted.  Lo¬ 
cal  reports,  while  vital,  can  be  sketchy. 


Bandwidth  can  degrade,  links  can  come 
up  and  down,  and  CNN  crews  can  be 
captured  and  disabled.  Units  assigned 
to  tasks  can  be  destroyed  or  otherwise 
incapacitated.  The  CAT  must  recognize 
such  occurrences  and  respond  quickly 
and  effectively  with  changes  in  plan. 
This  might  involve  drawing  on  new 
units  to  participate.  Such  units  must  be 
brought  on  board  quickly  with  both  the 
plan  and  the  situation.  If  a  crisis  goes 
on  long  enough,  the  CAT  itself  will  un¬ 
dergo  shift  changes.  Newly  arriving 
members  must  be  updated  rapidly  re¬ 
garding  the  situation  and  changes  in 
plan.  Eventually,  the  crisis  is  resolved, 
the  troops  return,  and  the  CAT  for  the 
specific  crisis  can  be  disbanded.  While 
responding  to  a  crisis  places  high  de¬ 
mands  on  the  people  and  systems  of  the 
U.S.  military,  the  demands  are  much 
higher  when  multiple  crises  occur  si¬ 
multaneously.  In  such  cases,  an  individ¬ 
ual  can  serve  at  once  on  multiple  crisis 
action  teams,  and  so  must  carefully 
manage  time  and  attention.  This  sce¬ 
nario  illustrates  how  military  crisis 
management  personnel  face  some  seri¬ 
ous  and  difficult  collaboration  chal¬ 
lenges. 

RECENT  ADVANCES  IN  CSCW 

Addressing  such  challenges  requires 
contributions  from  researchers  across  a 
range  of  specialties,  such  as  network¬ 
ing,  multimedia,  artificial  intelligence, 
visualization,  and  human-computer  in¬ 
teraction.  In  order  to  bring  such  diverse 
expertise  together,  in  1997,  DARPA  ini¬ 
tiated  a  three-year  research  program, 
known  as  the  Intelligent  Collaboration 
&  Visualization  (IC&V)  program  (for 
more  information,  see  http://www. 
darpa.mil/ito/research/icv).  The 
seventeen  papers  collected  in  this  sym¬ 
posium  describe  some  of  the  advances 
achieved  by  researchers  working  within 
the  IC&V  program.  The  papers  are  or¬ 
ganized  in  four  categories:  (1)  multime¬ 
dia  and  multimodal  collaboration;  (2) 
information  management  for  collabora¬ 
tion;  (3)  asynchronous  collaboration; 
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and  (4)  test  and  evaluation  for  collabo¬ 
rative  systems.  A  brief  synopsis  of  each 
paper  follows,  organized  by  category. 

ADVANCES  IN  MULTIMEDIA  AND 
MULTIMODAL  COLLABORATION 

In  “MASH:  Enabling  Scalable  Multi¬ 
point  Collaboration,”  Steve  McCanne 
et  al.  describe  a  new  generation  of  mul¬ 
timedia  conferencing  software  for  the 
Internet.  The  MASH  software,  based  on 
multicast  technology,  makes  possible 
synchronous  collaborative  sessions 
among  users  connected  through  a  di¬ 
verse  set  of  bandwidths  and  access  de¬ 
vices,  including  personal  digital  assis¬ 
tants,  Web-clients,  desktop 

workstations,  and  large-screen  displays. 
In  addition,  MASH  makes  possible  ar¬ 
chiving,  indexing,  and  replay  of  multi- 
media  collaborative  sessions.  In  order  to 
achieve  these  new  capabilities,  the 
MASH  architecture  includes  a  number 
of  novel  technologies:  programmable 
media  gateways,  scalable  reliable  multi¬ 
cast  protocols,  and  streaming  media 
transport  protocols.  Beyond  these  valu¬ 
able  research  results,  MASH  has  had 
early  practical  results  because  the  new 
conferencing  tools  from  the  project  are 
already  in  use  at  PACOM  to  support 
various  planning  activities  among 
teams  in  Hawaii,  San  Diego,  and  Wash¬ 
ington,  DC.  The  paper  provides  an  over¬ 
view  of  the  new  services  available  in 
MASH,  as  well  as  the  underlying  tech¬ 
nology  innovations  that  make  the  ser¬ 
vices  possible. 

In  “Semantic  Multicast:  Intelligently 
Sharing  Collaborative  Sessions,”  Son 
Dao  et  al.  describe  an  architecture, 
built  above  Internet  multicast,  to  dis¬ 
tribute  multimedia  information  effi¬ 
ciently  on  the  basis  of  relationships  be¬ 
tween  user  needs  and  network  topology. 
The  architecture  has  four  main  compo¬ 
nents.  First,  graph  discovery  algorithms 
organize  users  and  information  sources 
into  distribution  trees.  Second,  various 
realtime  and  offline  algorithms  extract 
metadata  from  multimedia  content  for 
redistribution  on  metadata  channels. 


Third,  based  on  the  metadata  and  the 
interests  of  users,  multimedia  streams 
are  matched  and  distributed  along  ap¬ 
propriate  network  channels.  Fourth,  a 
multimedia  database  provides  a  reposi¬ 
tory  that  can  be  enriched  with  offline 
processing,  searched  for  relevant  infor¬ 
mation,  and  replayed  for  users  who 
missed  live  multimedia  sessions.  The 
paper  provides  an  overview  of  the  archi¬ 
tecture  and  its  components. 

In  “DISCIPLE:  A  Framework  for  Mul¬ 
timodal  Collaboration  in  Heterogeneous 
Environments,”  Ivan  Marsic  discusses 
a  collaboration  system,  based  on  a  dis¬ 
tributed  Java-beans  event  model,  which 
integrates  two  novel  concepts.  First, 
desktop  users  collaborate  through  a 
multimodal  interface  that  integrates 
gesture  recognition,  gaze  tracking, 
speech  recognition,  and  speech  synthe¬ 
sis  with  the  usual  windows,  mouse,  and 
keyboard  interaction  modes.  A  number 
of  novel  technologies  implement  these 
modes.  For  example,  a  microphone  ar¬ 
ray  frees  collaborators  from  a  head- 
worn  microphone  and  a  force-feedback 
tactile  glove  provides  the  user  with  in¬ 
teraction  cues.  The  second  novel  concept 
in  DISCIPLE  is  the  ability  to  tradeoff 
remote  method  invocation  against  the 
use  of  mobile  code.  Based  on  observing 
interobject  message  traffic  for  specific 
functions,  a  rule  set  is  learned  that  en¬ 
ables  real-time,  knowledge-based  deci¬ 
sions  about  when  objects  should  be 
moved  and  when  objects  should  be  ac¬ 
cessed  remotely. 

In  “Virtue/Orbit:  Collaboration  and 
Visualization  Toolkits,”  Daniel  Reed 
and  Simon  Kaplan  discuss  two  soft¬ 
ware  toolkits  that  can  be  used  either 
independently  or  together  to  improve 
collaboration  in  data-intensive  environ¬ 
ments.  Orbit  provides  a  software  frame¬ 
work  to  support  users  simultaneously 
engaged  in  multiple  collaborative  tasks. 
The  Orbit  framework  visually  manages 
multiple  contexts,  while  enabling  users 
to  exercise  variable  control  over  their 
level  of  awareness  of  each  context.  Vir¬ 
tue  enables  users  to  collaborate  im- 
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mersed  within  massive  data  sets  and 
integrates  multiple  modalities  into  a 
software  and  hardware  system  that 
helps  users  visualize,  manipulate,  and 
annotate  complex  data.  In  addition  to 
discussing  the  main  concepts  underly¬ 
ing  the  two  toolkits,  the  authors  de¬ 
scribe  how  the  toolkits  can  be  used  to¬ 
gether  and  sketch  a  brief  scenario  to 
illustrate  the  collaborative  power  that 
can  be  achieved. 

In  “Creation  and  Performance  Analy¬ 
sis  of  User  Representations  in  Collabo¬ 
rative  Virtual  Environments,”  Kevin 
Martin  reports  results  from  an  experi¬ 
ment  to  determine  the  frame  update 
rate  achieved  when  using  various  ava¬ 
tars  to  represent  users  in  a  virtual  envi¬ 
ronment.  Martin  considers  nine  repre¬ 
sentations  for  head-only  avatars  and 
four  full-body  avatars,  and  also  mea¬ 
sures  the  avatars  with  and  without 
movement.  The  results  of  this  experi¬ 
ment  should  help  to  inform  designers 
who  must  choose  among  particular  ava¬ 
tars  when  designing  collaborative  vir¬ 
tual  environments. 

The  five  papers  are  on  a  spectrum 
from  near-term  to  longer-term.  The 
MASH  project  has  already  delivered 
beta  software  that  permits  users  to  col¬ 
laborate  across  a  range  of  bandwidths 
and  devices.  The  project  is  now  explor¬ 
ing  mechanisms  for  constructing  a  con¬ 
ference  bus  to  support  shared  control  of 
devices  by  the  members  of  a  collabora¬ 
tive  session.  Beyond  that,  the  project 
expects  to  deliver  improved  scalability 
for  reliable  delivery  of  information 
among  groups  and  to  archive  multime¬ 
dia  sessions,  so  that  others  may  search 
and  replay  them  later.  Complementing 
the  archiving  capabilities  of  the  MASH 
toolkit,  the  Semantic  Multicast  project 
will  provide  technology  to  aid  in  the 
indexing  and  distribution  of  multimedia 
sessions,  both  in  realtime  and  during 
replay,  while  conserving  overall  net¬ 
work  bandwidth.  The  DISCIPLE  project 
complements  the  capabilities  of  MASH 
in  two  ways.  First,  DISCIPLE  presents 
a  multimodal  interaction  model  that 
MASH  could  incorporate  into  its  confer¬ 


ence  bus.  Second,  DISCIPLE  will  pro¬ 
vide  knowledge-based  rules  that  MASH 
could  exploit  to  select  which  MASH  ob¬ 
jects  should  be  replicated  for  local  ac¬ 
cess.  The  Virtue  project  contributes  an 
advanced  form  of  multimodal  interac¬ 
tion  through  which  selected  collabora¬ 
tors  can  immerse  themselves  in  the 
structure  and  behavior  of  massive  data 
sets.  The  Orbit  project  contributes  an 
information  structure  and  user  inter¬ 
face  tuned  for  collaborators  who  must 
juggle  simultaneously  multiple  collabo¬ 
rative  sessions.  One  could  easily  imag¬ 
ine  a  future  software  toolkit  that 
merges  the  best  ideas  from  these 
projects  into  a  versatile  and  adaptive 
collaboration  environment.  The  final  pa¬ 
per  in  this  set  tackles  a  specific  issue  in 
multimodal  collaboration.  Low  band¬ 
width  often  prevents  the  injection  of 
video  representations  into  a  collabora¬ 
tive  session.  In  such  cases,  avatars  can 
be  loaded  locally  on  each  machine  and 
then  animated  based  on  small  messages 
sent  sporadically  to  represent  the  state 
of  remote  collaborators.  In  such  situa¬ 
tions,  the  specific  avatars  to  choose 
might  depend  upon  the  amount  of  pro¬ 
cessing  power  needed  to  render  and  an¬ 
imate  them.  Martin  reports  results  that 
can  guide  designers  who  must  match 
avatars  with  processing  power. 

ADVANCES  IN  INFORMATION 
MANAGEMENT  FOR  COLLABORATION 

In  “Rough’N’Ready:  A  Meeting  Recorder 
and  Browser,”  Francis  Kubala  et  al. 
describe  a  prototype  system  that  auto¬ 
matically  constructs  a  browsable  index 
from  audio  streams.  The  system  inte¬ 
grates  four  individual  technologies 
(speech-to-text  transcription,  speaker 
demarcation,  named  entity  extraction, 
and  topic  classification)  to  consume  au¬ 
dio  streams  and  to  produce  a  tagged 
metadata  file  containing  an  index  into 
the  raw  audio.  The  system  also  includes 
a  Web-client  plug-in  that  helps  the  user 
browse  and  query  the  audio  stream  for 
particular  speakers,  topics,  and  named 
entities.  The  authors  discuss  the  perfor- 
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mance  of  each  technology  and  outline 
their  future  research  plans.  To  date,  the 
system  has  been  applied  to  broadcast- 
quality  audio  from  news  sources.  Future 
plans  include  investigating  the  feasibil¬ 
ity  of  applying  the  technology  to  low- 
quality  audio  in  conversational  applica¬ 
tions,  such  as  multimedia  conferencing. 

In  “Dynamic  Collaborator  Discovery 
in  Information-Intensive  Environ¬ 
ments,”  David  Payton  et  al.  present  a 
novel  way  to  discover  potential  collabo¬ 
rators  based  on  comparison  of  individ¬ 
ual  patterns  of  Web  browsing.  As  indi¬ 
viduals  browse  the  Web,  their  accesses 
are  typically  logged  at  a  firewall.  By 
converting  these  accesses  into  graphs 
for  each  user  and  then  matching  the 
graphs,  similarities  and  differences  can 
be  detected  and  users  brought  into  con¬ 
tact.  Payton  et  al.  describe  the  architec¬ 
ture  of  a  prototype  system  deployed  in¬ 
side  their  company.  The  authors  also 
address  the  mechanisms  to  overcome 
privacy  concerns  that  might  otherwise 
be  raised  by  their  approach.  They 
briefly  present  visual  designs  that  en¬ 
able  users  to  explore  possible  matching 
interests  with  other  users.  Finally,  the 
authors  discuss  experimental  results 
obtained  by  using  the  system. 

In  “Informedia  Experience-on-De- 
mand:  Capturing,  Integrating  and  Com¬ 
municating  Experiences  Across  People, 
Time  and  Space,”  Howard  Wactlar  et 
al.  discuss  a  prototype  system  that  uses 
speech,  image,  and  natural  language 
processing,  combined  with  GPS  infor¬ 
mation,  to  capture,  integrate,  and  com¬ 
municate  personal  multimedia  experi¬ 
ences.  The  main  premise  of  this 
research  is  that  individuals,  augmented 
with  audio,  video,  and  GPS  recording 
devices,  can  capture  a  complete  multi- 
media  record  of  their  experiences.  Such 
experiences,  uploaded  and  integrated  in 
a  database,  can  then  be  indexed,  inte¬ 
grated,  summarized,  and  searched.  The 
authors  identify  a  number  of  potential 
applications  for  such  a  system,  includ¬ 
ing  allowing  a  military  commander  to 
better  understand  an  unfolding  situa¬ 


tion  by  combining  the  individual  views 
of  subordinate  units. 

In  “Task-Based  Information  Manage¬ 
ment,”  Michael  Wolverton  et  al.  dis¬ 
cuss  a  prototype  system  for  automati¬ 
cally  routing  incoming  documents  to 
specific  individual  team  members.  The 
system  relies  on  Bayesian  task  graphs, 
where  each  node  in  the  graph  contains  a 
key  question,  a  template  of  parameters, 
and  a  set  of  relevant  keywords.  Proba¬ 
bilities  are  assigned  to  each  item  in 
each  node.  A  Bayesian  task  graph,  when 
instantiated  with  specific  parameters 
and  probabilities,  is  used  to  generate  a 
query  weighted  for  the  related  task.  As 
documents  arrive  into  a  repository,  the 
generated  queries  are  applied  and  the 
documents  are  routed  to  users  who  meet 
the  requirements  of  those  who  are 
needed  to  help  complete  a  task.  After 
describing  how  the  system  works,  the 
authors  indicate  the  current  status  of 
the  prototype  and  the  plan  for  addi¬ 
tional  research. 

During  large-scale  undertakings  that 
involve  numerous  collaborative  sessions 
with  many  participants  per  session, 
massive  amounts  of  multimedia  infor¬ 
mation  are  generated,  shared,  and  con¬ 
sumed.  The  four  projects  outlined  above 
consider  means  to  improve  the  accessi¬ 
bility  of  such  information.  Three  of  the 
projects,  Rough’N’Ready,  Dynamic  Col¬ 
laborator  Discovery,  and  Experience-on- 
Demand,  rely  on  post-hoc  analysis  of 
passively  recorded  information,  while 
the  fourth,  Task-Based  Information 
Management,  actively  queries  informa¬ 
tion  for  matches  against  task  models. 
Rough’N’Ready  aims  to  produce  multi¬ 
valued  indices  for  a  collaborative  ses¬ 
sion,  based  solely  on  analyses  of  the 
session  audio.  This  technique  should 
prove  very  versatile  because  most  col¬ 
laborative  sessions  involve  some  form  of 
voice  communication.  The  second 
project,  Dynamic  Collaborator  Discov¬ 
ery,  performs  graph  matching  against 
passively  collected  records  of  Web-surf¬ 
ing  behavior  among  a  group  of  people. 
The  matching  is  used  to  identify  and 
suggest  people  who  might  profit  from 
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collaborating  with  each  other.  The  third 
project,  Experience-on-Demand,  collects 
and  integrates  multimedia  data  from 
the  viewpoint  of  many  individuals.  Once 
collected,  the  multimedia  data  is  fused, 
indexed,  and  summarized  so  that  indi¬ 
viduals  can  query  the  entire  situation 
for  patterns  and  information  not  known 
to  them  when  looking  strictly  from  their 
own  viewpoint.  The  fourth  project, 
Task-Based  Information  Management, 
requires  preparatory  work  to  design,  se¬ 
lect,  and  parameterize  task  models 
prior  to  beginning  collaborative  ses¬ 
sions.  During  collaborative  sessions,  ac¬ 
tive  queries,  generated  from  the  instan¬ 
tiated  task  models,  monitor  newly 
discovered  or  generated  documents  and 
route  them  to  particular  people  that 
might  need  to  see  them  in  order  to 
complete  a  task.  Combining  all  of  the 
monitoring  and  indexing  methods  dis¬ 
cussed  here  can  substantially  increase 
the  usefulness  of  any  archive  of  collabo¬ 
rative  sessions. 


ADVANCES  IN  ASYNCHRONOUS 
COLLABORATION 

In  “Interface  Issues  in  Computer  Sup¬ 
port  for  Asynchronous  Communication,” 
Jim  Morris  et  al.  argue  that  generic 
computer  tools,  such  as  email  readers, 
provide  insufficient  support  for  collabo¬ 
rators  working  together  intermittently 
on  a  specific  task.  Instead  of  generic 
tools,  they  suggest  that  next-generation 
tools  for  asynchronous  collaboration 
need  to  support  emergent,  task-specific 
representations  that  can  be  shared  in 
whole  or  part  under  control  of  individ¬ 
ual  collaborators.  In  addition,  they  posit 
that  effective  tools  for  asynchronous  col¬ 
laborators  must  provide  a  means  to 
grasp  the  context  of  a  collaborative  ses¬ 
sion  quickly,  whenever  collaborators  re¬ 
turn  to  a  joint  task.  The  authors  sup¬ 
port  their  ideas  by  reporting  results 
from  a  case  study.  While  not  covered 
specifically  in  this  paper,  PACOM  has 
expressed  interest  in  using  a  prototype 
tool  designed  by  the  authors  to  enable 


flexible  querying  and  presentation  of  in¬ 
coming  electronic  mail. 

In  “Integration  of  Synchronous  and 
Asynchronous  Collaboration  Activities,” 
Larry  Jackson  and  Ed  Grossman  de¬ 
scribe  extensions  to  Habanero,  a  Java- 
based  system  for  synchronously  sharing 
applications.  These  extensions  enable 
Habanero  sessions  to  persist  even  when 
all  participants  are  absent,  and  also 
permit  collaborators  to  participate  in 
Habanero  sessions  without  using  Ha¬ 
banero.  In  addition,  Jackson  and  Gross- 
man  describe  how  Habanero  can  be 
used  to  collaborate  effectively  when  a 
session  can  obtain  only  limited  band¬ 
width.  Habanero,  including  its  exten¬ 
sions  for  persistent  sessions,  is  freely 
available  for  download  and  use. 

In  ’’Consistency  Management  for  Dis¬ 
tributed  Collaboration,"  Sankar 
Virdhagriswaran  et  al.  propose  a  new 
mechanism  for  configuration  manage¬ 
ment  in  distributed  systems  where 
teams  asynchronously  update  jointly 
authored  documents.  The  main  contri¬ 
bution  of  their  approach  is  to  separate 
proposed  changes  to  a  document  space 
from  the  orthogonal  issues  of  concur¬ 
rency  control  and  repository  manage¬ 
ment.  Specifically,  as  a  collaborator  up¬ 
dates  a  copy  of  a  shared  document,  the 
updates  are  recorded  in  change  propos¬ 
als  that  track  information  the  collabora¬ 
tor  expects  to  revise  and  that  record 
consistency  relationships  which  must  be 
maintained.  Once  recorded,  change  pro¬ 
posals  can  themselves  be  treated  as 
shared  documents.  The  change  proposal 
mechanism  is  implemented  in  a  proto¬ 
type  system  for  asynchronous  collabora¬ 
tion.  The  proposal  outlined  in  this  paper 
is  included  in  Concorde,  a  new  collabo¬ 
ration  system  offered  by  Crystaliz. 

In  ’’Intermediary  Architecture:  Inter¬ 
posing  Middleware  Object  Services  Be¬ 
tween  Web  Client  and  Server,"  Craig 
Thompson  et  al.  present  an  architec¬ 
ture  that  places  distributed  object  ser¬ 
vices  between  a  Web  client  and  server. 
By  adding  a  distributed  object  services 
plug-in,  Thompson  hopes  to  improve  the 
ability  of  Web-based  technology  to  im- 
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plement  distributed  applications.  The 
paper  discusses  two  sample  applica¬ 
tions:  a  Web  annotation  service  and  a 
personal  Web  performance  monitor.  The 
paper  also  discusses  some  lessons 
learned  during  the  design  and  imple¬ 
mentation  and  identifies  some  open  is¬ 
sues  that  remain  to  be  addressed. 

Perhaps  the  most  difficult  issues  for 
collaborative  systems  revolve  around 
providing  support  for  asynchronous  col¬ 
laboration,  where  progress  occurs  based 
on  contributions  from  independent  peo¬ 
ple  who  might  not  meet  at  the  same 
time,  even  in  electronic  form.  The  four 
papers  outlined  above  make  modest  con¬ 
tributions  toward  solving  some  of  these 
difficult  issues.  The  first  paper  investi¬ 
gates  how  to  empower  users  to  express 
task-specific  information  in  a  succinct 
and  meaningful  form.  Should  its  ideas 
prove  feasible,  then  users  no  longer 
need  to  resort  to  heroic  means  to  track 
the  state  of  task-specific  collaborative 
activities.  The  second  paper  describes 
extensions  made  to  Habanero,  a  suc¬ 
cessful  system  for  synchronously  shar¬ 
ing  applications.  The  extensions  provide 
for  persistence  of  collaborative  sessions 
and  also  provide  a  mechanism  through 
which  nonHabanero  users  can  partici¬ 
pate  in  Habanero  collaborative  sessions. 
This  platform  could  provide  an  interest¬ 
ing  base  on  which  researchers  could  ex¬ 
periment  with  user  interface  improve¬ 
ments  for  asynchronous  collaborators. 
The  third  paper  contributes  a  mecha¬ 
nism  to  propose  changes  to  systems  of 
replicated  objects  independently.  Such  a 
mechanism  provides  a  fundamental  ser¬ 
vice  for  asynchronously  collaborating 
around  copies  of  documents.  The  fourth 
paper  discusses  an  approach  to  insert¬ 
ing  distributed  object  systems  between 
a  Web  client  and  server.  Integrating 
distributed  object  services  into  the  Web 
client-server  model  improves  the  flexi¬ 
bility  available  to  build  asynchronous 
collaborative  applications.  While  mak¬ 
ing  only  modest  contributions,  the  four 
papers  discussed  here  attempt  to  im¬ 
prove  asynchronous  collaboration  pro¬ 
cesses.  Ultimately,  improvements  in 


asynchronous  collaboration  will  likely 
provide  the  largest  payback  for  the  re¬ 
search  invested. 

ADVANCES  IN  TEST  AND  EVALUATION 
FOR  COLLABORATIVE  SYSTEMS 

In  “Evaluation  for  Collaborative  Sys¬ 
tems,”  Laurie  Damianos  et  al.  discuss 
the  challenges  inherent  in  evaluating 
collaboration  environments  and  present 
a  four-level  framework  to  evaluate  col¬ 
laborative  systems  using  a  scenario- 
driven  approach.  Each  level  of  the 
framework  includes  components  and  re¬ 
lated  metrics.  At  the  top  level,  the 
framework  considers  the  characteristics 
of  a  collaborating  team,  as  well  as  re¬ 
quirements  for  work  tasks,  for  transi¬ 
tion  between  tasks,  and  for  social  proto¬ 
cols.  At  the  second  level,  the  framework 
encompasses  specific  capabilities  to  sup¬ 
port  the  requirements  of  a  team.  For 
example,  such  capabilities  might  in¬ 
clude  shared  workspace,  shared  view, 
and  group  communication.  Pushing 
lower,  the  third  level  documents  the 
menu  of  services  that  could  be  used  to 
provide  the  capabilities  of  level  two.  For 
example,  services  could  include  white¬ 
boards,  text  chat,  3D  visualization,  ap¬ 
plication  sharing,  and  so  on.  At  its  foun¬ 
dation,  the  framework  considers  specific 
products  and  implementations  that  can 
provide  needed  services.  Using  this 
framework,  evaluators  can  identify  the 
specific  level  and  component  they  wish 
to  evaluate  and  the  metrics  to  use.  In 
addition,  given  a  set  of  requirements, 
users  can  navigate  to  the  capabilities, 
services,  and  implementations  that  can 
support  their  requirements.  Conversely, 
given  a  specific  implementation,  devel¬ 
opers  can  identify  the  services,  capabil¬ 
ities,  and  requirements  that  can  be  pro¬ 
vided. 

In  “Reconfigurable  Distributed  Script¬ 
ing,”  M.  Ranganathan  et  al.  describe  a 
distributed  scripting  system,  based  on 
mobile  code,  which  can  be  used  to  con¬ 
figure  and  test  collaborative  applica¬ 
tions  from  recorded  log  data;  thus  pro¬ 
viding  repeatable  testing  without  the 
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need  to  repeatedly  assemble  teams  of 
people  to  conduct  the  tests.  The  authors 
explain  an  innovative  technology,  called 
Mobile  Streams,  which  underlies  this 
distributed  scripting  system,  and  then 
describe  the  use  of  Mobile  Streams  to 
build  a  self-reconfiguring  chat  applica¬ 
tion.  The  authors  also  discuss  the  mech¬ 
anism  to  control  configuration  policy  on 
three  levels:  system-wide,  node-wide, 
and  stream-specific.  A  system  based  on 
mobile  code  must  support  configuration 
control  policies  in  order  to  protect  the 
integrity  of  system  components. 

In  “The  MITRE  Multimodal  Logger: 
Its  Use  in  Evaluation  of  Collaborative 
Systems,”  Samuel  Bayer  et  al.  briefly 
present  the  capabilities  of  a  multimodal 
logging  tool  and  then  illustrate  its  ap¬ 
plication  to  help  evaluate  two  collabora¬ 
tive  applications.  A  particularly  inter¬ 
esting  aspect  of  the  logger  is  its  ability 
to  visualize  many  multimodal  data 
streams  in  parallel  along  a  time  scale. 
In  effect,  the  visual  presentation  be¬ 
comes  a  user-friendly  index  into  the  log. 
Logged  data  can  also  be  exported  in 
tab-delimited  format  to  support  spread¬ 
sheet  analysis. 

In  “The  MITRE  Map  Navigation  Ex¬ 
periment,”  Laurie  Damianos  et  al.  re¬ 
port  results  from  an  experiment  de¬ 
signed  to  assess  the  effectiveness  of 
various  collaboration  services,  such  as 
audio,  text  chat,  and  whiteboard,  when 
used  for  tasks  that  require  information 
sharing  and  collaborative  planning.  To 
design  the  experiment,  the  authors  used 
the  four-level  evaluation  framework  de¬ 
scribed  above;  to  collect  and  analyze 
data,  they  used  the  multimodal  logger 
discussed  in  the  preceding  paper.  For  a 
collaborative  route-planning  task,  the 
authors  found  that  collaborators  pro¬ 
duced  successful  routes  significantly 
faster  when  audio  was  used.  In  addi¬ 
tion,  collaborators  engaged  in  more  fre¬ 
quent  interaction  and  were  more  satis¬ 
fied  with  the  collaborative  experience 
when  audio  was  used.  The  quality  of  the 
task  results  did  not  vary  significantly, 
whether  or  not  audio  was  used. 

As  shown  in  these  four  papers,  testing 


and  evaluating  collaborative  systems 
presents  some  unusual  challenges. 
Evaluating  collaborative  systems  re¬ 
quires  enlisting,  or  simulating,  the  pres¬ 
ence  of  a  group  of  people  to  participate 
in  test  scenarios  during  which  interac¬ 
tions  are  logged  in  order  to  make  possi¬ 
ble  measurements  of  interest.  The  first 
paper  above  describes  the  framework 
for  accomplishing  all  of  this.  Evaluators 
can  use  the  framework  as  a  guide  and 
can  contribute  substantively  to  the 
framework  by  submitting  scenarios, 
metrics,  and  logging  and  test  tools.  The 
second  paper  describes  a  tool  that  en¬ 
ables  multiuser  interactions  to  be 
logged  and  replayed  later  in  a  range  of 
controllable  configurations.  Tools  of  this 
sort  enable  collaborative  test  scenarios, 
involving  real  users,  to  be  reused  in 
various  ways.  When  conducting  a  test, 
logging  and  analyzing  the  multimodal 
interactions  of  a  collaborative  group  can 
be  challenging.  The  third  paper  shows 
one  means  of  performing  such  logging 
and  analysis.  When  all  of  these  ele¬ 
ments  come  together,  as  illustrated  in 
the  fourth  paper,  a  productive  experi¬ 
ment  can  be  conducted  and  valid  results 
reported. 

CONCLUSIONS 

Computers  and  networks  hold  great  po¬ 
tential  to  improve  the  ability  of  people 
to  work  together  effectively  in  teams. 
Yet  despite  advances  in  processing 
power  and  bandwidth,  the  exponential 
growth  in  the  size  of  the  World-Wide 
Web,  and  the  nearly  ubiquitous  deploy¬ 
ment  of  a  de  facto  standard  commercial 
operating  system,  effective  computer- 
supported  collaboration  eludes  us.  The 
DARPA  IC&V  program  explored  the 
premise  that  significant  advances  in 
computer-supported  cooperative  work 
can  best  be  achieved  by  mixing  together 
ideas  from  the  most  talented  research¬ 
ers  across  a  range  of  disciplines,  includ¬ 
ing  networking,  multimedia,  artificial 
intelligence,  visualization,  and  human- 
computer  interaction.  As  shown  in  the 
papers  in  this  symposium,  the  results  to 
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date  have  proven  significant;  however, 
the  best  is  yet  to  come,  as  research 
connections  made  during  the  program 
foster  innovative  ideas  for  future  re¬ 
search. 
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